Assigning QoS to cable service flows

ABSTRACT

A novel method of handling network traffic for cable service flows in a distributed cable system is presented. Such a cable systems use remote distribution nodes in the fields to handle RF communications with cable modems in a distributed fashion. A packet engine is configured to assign a logical interface to each cable service flow in the cable system. Each logical interface in the packet engine is uniquely identifiable by a compound identifier that includes the identifier of the corresponding service flow and the identifier of the remote distribution node. Each service flow is assigned a class of service (CoS) at the packet engine and guarantee a certain level of quality of service (QoS). In some embodiments, each cable service flow is assigned a CoS priority number. For each possible CoS priority number, the packet engine is configured to provide certain resources at certain quality level, i.e., certain level of QoS. Each remote distribution node tags each packet of a cable service flow with its assigned CoS priority number and forwards the tagged packet toward the packet engine.

CLAIM OF BENEFIT TO PRIOR APPLICATIONS

The present Application claims the benefit of U.S. Provisional Patent Application 62/141,804, filed Apr. 1, 2015. U.S. Provisional Patent Applications 62/141,804 is incorporated herein by reference.

BACKGROUND

Cable television (CATV), originally introduced in the late 1940's as a way to transmit television signals by coaxial cables to houses in areas of poor reception, has over the years been modified and extended to enable the cable medium to transport a growing number of different types of digital data, including both digital television and broadband Internet data.

One of the most significant improvements occurred in the 1990's, when a number of major electronics and cable operator companies, working through CableLabs, a non-profit R&D consortium, introduced the Data Over Cable Service Interface Specification (DOCSIS). First introduced in the late 1990's as DOCSIS version 1.0, and upgraded many times since (currently at DOCSIS version 3.0, with a draft DOCSIS 3.1 specification released in 2013), the DOCSIS standard defines the Physical Layers (PHY) and Media Access Control (MAC) layers needed to send relatively large amounts of digital data through coaxial cables that were originally designed to handle analog standard definition television channels.

This television signal was transmitted as a combination amplitude modulated signal (for the black and white portion), quadrature-amplitude modulated signal (for the color portion), and frequency modulated signal (for the audio portion), and this combined signal will be designated as a Frequency Division Multiplexed (FDM) signal. With the advent of digital television and high definition television standardization in the late 1980's and early 1990's, the basic 6 MHz bandwidth spectrum of analog television was retained, but the modulation scheme was changed to a more sophisticated and higher data rate Quadrature Amplitude Modulation (QAM) scheme, which can encode digital information onto a very complex QAM analog signal (waveform).

The DOCSIS standard was built upon this analog and digital TV foundation, and specified additional standards to provide broadband Internet services (Internet protocols, or IP), voice over IP, custom video on demand, and other modern services based upon the QAM data transmission waveforms previously established for digital and high definition television.

As a result, simple coaxial cables have been gradually upgraded to accommodate ever-increasing demands for digital data. At each house (or apartment, office, store, restaurant or other location), the household connects to the CATV cable by a cable modem, uses the cable modem to extract downstream DOCSIS digital data (frequently used for high-speed Internet), and inject upstream DOCSIS digital data (again frequently used for high-speed Internet applications).

Unfortunately, even in a coax cable, there is a finite amount of bandwidth available to transmit data. Coax cables and their associated radiofrequency interface equipment have typically only used the frequency range under about 1000 MHz, and so there are limits to how much data the 1950's era coaxial cable can ultimately transmit. By contrast, optical fiber (fiber optics, fiber) technology, which uses much higher optical frequencies (with wavelengths typically in the 800-2000 nanometer range), can transmit a much higher amount of data. Optical fiber data rates typically are in the tens or even hundreds of gigabits per second. Indeed, the entire RF CATV cable spectrum from 0 to 1000 MHz can be converted to optical wavelengths (such as 1310 nm or 1550 nm), be carried over an optical fiber, and then be converted back to the full RF CATV cable spectrum at the other end of the fiber, without coming close to exhausting the ability of the optical fiber to carry additional data. This conversion process can be achieved by relatively simple optical to digital or digital to optical converters, in which the CATV RF waveforms are simply converted back and forth to a light signal by simple (“dumb”) E/O or O/E converters, located in nodes that connect optical fibers to CATV cable (fiber nodes).

Optical fiber technology has been widely used for high capacity computer networks, and these networks often do not use the DOCSIS protocols or QAM protocols to transmit data. Rather, these high capacity computer networks often use entirely different types of data transmission protocols, such as the Ethernet protocols IEEE 802.3ah, 1000BASE-LX10, 1000Base-BX10, and others. These networks and protocols are often referred to as GigE networks, which is an abbreviation of the Gigabyte speeds and Ethernet protocols used for fiber based computer network. Thus if a user desires to transfer computer data from RF QAM waveforms transported over a CATV cable to a high speed GigE fiber network, the data must be transformed back and forth between the DOCSIS cable QAM waveforms and the alternate protocols (often Ethernet protocols) used in fiber GigE networks.

Although ideally, the best way to satisfy the ever increasing household demand for digital data (e.g. video-on demand, high speed Internet, voice over IP, etc.) would be by extending optical fiber to each household, this would be an incredibly expensive solution. By contrast, cable based CATV solutions have already been implemented for tens of millions of households, and this expense has already been borne and amortized over decades of use, starting from the 1950s. As a result, it is far more economically attractive to find schemes enable the existing, if bandwidth limited, CATV cable system, to be further extended to meet the ever-growing demands for additional data.

SUMMARY

Some embodiments provide a novel method of mapping cable service flows to an IP network in a distributed CATV cable system, or virtualized CCAP system (VCAP). Such a cable systems use remote distribution nodes in the fields to handle RF communications with cable modems in a distributed fashion. Some embodiments use a packet engine to handle the exchange of network data to and from the cable service flows. In some embodiments, the packet engine has an array of logical interfaces, and each cable service flow is assigned one of these logical interfaces. Each logical interface is configured to receive data or data packets from its corresponding cable service flow and to provide data or data packet to its corresponding cable service flow. The packet engine in turn perform data packet exchange between the logical interfaces and the network, which includes L2 switches, L3 routers, network services (such as DHCP, firewall, NAT, etc.), access to Internet or other external networks (through a gateway/edge router), etc.

In some embodiments, the packet engine is configured to assign a logical interface to each of these cable service flows. Some embodiments associate the identifier of a remote distribution node with a cable service flow in addition to the cable service's own identifier. Consequently, each logical interface in the packet engine is uniquely identifiable by a compound identifier that includes the identifier of the corresponding service flow and the identifier of the remote distribution node. In some embodiments, each service flow is defined as a cable modem, or as the subscribing household. In some embodiments, the identifier of the cable bundle and the identifier of the service unit form a compound identifier [cable bundle identifier, service identifier] for the service unit. The compound identifier of the service unit is then further compounded with the identifier of the remote distribution node to form the compound identifier for uniquely identifying the service flow.

In some embodiments, each service flow is assigned a class of service (CoS) at the packet engine and guarantee a certain level of quality of service (QoS). In some embodiments, each cable service flow is assigned a CoS priority number. For each possible CoS priority number, the packet engine is configured to provide certain resources at certain quality level, i.e., certain level of QoS. In some embodiments, each remote distribution node (FN or EN) tags each packet of a cable service flow with its assigned CoS priority number and forwards the tagged packet toward the packet engine.

The preceding Summary is intended to serve as a brief introduction to some embodiments of the invention. It is not meant to be an introduction or overview of all inventive subject matter disclosed in this document. The Detailed Description that follows and the Drawings that are referred to in the Detailed Description will further describe the embodiments described in the Summary as well as other embodiments. Accordingly, to understand all the embodiments described by this document, a full review of the Summary, Detailed Description and the Drawings is needed. Moreover, the claimed subject matters are not to be limited by the illustrative details in the Summary, Detailed Description and the Drawings, but rather are to be defined by the appended claims, because the claimed subject matters can be embodied in other specific forms without departing from the spirit of the subject matters.

BRIEF DESCRIPTION OF THE DRAWINGS

The novel features of the invention are set forth in the appended claims. However, for purpose of explanation, several embodiments of the invention are set forth in the following figures.

FIG. 1 illustrates a cable system that includes a packet engine for handling the IP/Ethernet traffic of the cable system.

FIG. 2 illustrates cable service flows in the cable system.

FIG. 3 illustrates a packet engine that is configured to handle packet exchange for cable service flows in a cable system.

FIG. 4 illustrates cable service flows that are each a service unit under a cable bundle.

FIG. 5 illustrates cable service flows that are each defined as a cable modem.

FIG. 6 illustrates the assignment CoS priority numbers and the configuration of a packet engine for the service flows of a cable system.

FIG. 7 illustrates tagging packets of a service flow with the service flow's assigned CoS priority number.

FIG. 8 conceptually illustrates a process for configuring the packet engine and the remote distribution nodes in order to implement QoS specification for the service flows.

FIG. 8 also conceptually illustrates a process for tagging packets of a service flow according to its assigned QoS priority.

FIG. 9 conceptually illustrates an electronic system with which some embodiments of the invention are implemented.

DETAILED DESCRIPTION

In the following description, numerous details are set forth for the purpose of explanation. However, one of ordinary skill in the art will realize that the invention may be practiced without the use of these specific details. In other instances, well-known structures and devices are shown in block diagram form in order not to obscure the description of the invention with unnecessary detail.

Some embodiments provide a novel method of mapping cable service flows to an IP network in a distributed CATV cable system, or virtualized CCAP system (VCAP). Unlike a conventional CCAP system in which the cable head end is a cable modem termination system (CMTS) device that directly provides modulated RF signals through CATV cables to the cable modems, a VCAP system uses remote distribution nodes in the fields (remote from the central office) to handle all of the RF communications with cable modems in a distributed fashion. This leaves the central cable head end to be an all-IP/all-Ethernet hub, and the packet engine of the cable system is in some embodiments located at the cable head end for handling the IP/Ethernet traffic. Such a cable system is therefore also referred to as a distributed cable management system (DCMS). In some embodiments, the remote distribution nodes distribute the functionality of the CMTS device out into the field as if the line cards of the CMTS are remotely located in the individual neighborhoods so that the CATV cables need not run all the way to the cable head end to receive the cable RF signals. Consequently, the remote distribution nodes are also referred to as Cable Modem Remote Termination System (CMRTS) devices in some embodiments.

FIG. 1 illustrates a cable system 100 that includes a packet engine 110 for handling the IP/Ethernet traffic of the cable system. The cable system and the packet engine are configured by device-specific configuration commands that are generated from normalized data models describing the cable system 100. As illustrated, the cable system 100 is a VCAP or DCMS system that has devices deployed in its head end and in the fields. Specifically, the head end includes the packet engine 115, a controller 190, an edge router 180, and a packet switch 160, while the field includes remote distribution nodes 131-135, neighborhood CATV cables 141-145, and subscriber nodes (or service nodes) 151-159. In some embodiments, the edge router 180, the packet engine 115 and the switch 160 are located within one facility (i.e., the headend of the cable system), while the remote distribution nodes 131-135 and the subscriber nodes 151-159 are in remote locations (collectively referred to as the “field” in some embodiments). In some embodiments, the switch 160, the packet engine 115, and the edge router 180 are each implemented by a set of one or more devices, and therefore can be referred to as a set of switches, a set of packet engines, and a set of edge routers, respectively.

The head end and the fields are interconnected by a distribution network 120. The remote distribution network 120 is for distributing downstream data from the cable head end 110 to the remote distribution nodes 131-135 in the fields and for receiving upstream data from the remote distribution nodes 131-135 in the fields to the cable head end 110. In some embodiments, the distribution network is a network of high capacity communication medium such optical fiber, which in some embodiments runs from the cable head end 110 to the remote distribution nodes 131-135.

The cable system 100 provides many different types of services (such as Internet access, analog television channels, digital television channels, on-demand channels, voice over IP, DOCSIS channels, etc.) to service nodes 151-159 at many different locations. The distributed architecture of this system is designed such that it can provide the service nodes with high-speed data for the desired services in a scalable, cost effect manner.

The edge router 180 connect the packet engine 115, and thereby the switches 160, the remote distribution nodes 131-135 and subscriber nodes 151-159, to the Internet 170. The edge routers handle north-south data packet traffic out of and into the DCMS 100. The packet engine 115 is responsible for routing packets to and from the devices 142 at the subscriber nodes 151-159 through the switches 160 and the remote distribution nodes 131-135. Each packet engine has limited number of input ports, which may not be able to accommodate traffic for a far greater number of remote distribution nodes for which the packet engine is responsible. Hence, the switch (or the set of switches) 160 is inserted between the packet engine 115 and the remote distribution nodes 131-135.

The switch 160 is located in the cable head end 110 or in the data distribution network 120. In some embodiments, the switch 160 serves as point-to-point connections between the remote distribution nodes and the packet engine 115. As such, the remote distribution nodes 131-135 do not communicate with each other through the switch 160 directly, but rather through L2 and L3 switching/routing facilities provided by the packet engine 115.

Each remote distribution node connects multiple subscriber nodes to the cable headend of the cable system 100. The subscriber nodes that are serviced by one remote distribution node are typically within one contiguous geographic region. In some embodiments, a service node represents a subscriber of cable services. Such a subscriber can be a household, an apartment, an office, etc. A service node is also therefore also referred to as a subscriber node in some embodiments. A service node includes one or more cable modems 142 for receiving and transmitting cable signals on its neighborhood CATV cable.

A cable modem 142 at a service node 151-153 in turn translates the received cable signals into data for subscribing devices 142 (e.g., set top box (STB), customer premise equipment (CPE), computers, handheld devices, multimedia terminal adapter (MTA), etc.) or for subscribed cable services (e.g., video on demand, voice over IP, etc.). In some embodiments, some of the subscribing devices have their own modems for directly receiving the subscribed services, such as an embedded MTA (eMTA).

In some embodiments, each remote distribution node 131-135 communicatively (1) connects to the switch 160 through one or more fiber optic cables to exchange digital data packets, and (2) connects to numerous service nodes (e.g., tens to hundreds of service nodes) through CATV cables to exchange radio frequency (RF) modulated signals. In some embodiments, each remote distribution node is an Ethernode (EN) that is associated with a MAC address, enabling a switch to direct to the EN the packets that are address to it and forward packets that are sent by the EN. This distributed architecture of system 100 is referred to as a remote MAC and PHY architecture because the in-the-field ENs that service multiple service nodes are MAC addressable, receive digital data packets, and perform the physical layer conversion to convert the digital data packets to RF signals in the field.

Each EN in some embodiments converts data packets from the cable headend into a DOCSIS compliant RF signal that are to be processed by DOCSIS compliant cable modems at the service nodes. In some embodiments, an EN strips the header information of the downstream IP packets it receives and delivers only the payload to the cable modem through the CATV cable. In other embodiments, an EN transmits the downstream IP packets in their entirety (header and payload) to the CATV cable. In some embodiments, the payloads of IP packets are digitized samples of RF waveforms, and the EN uses the digitized samples to reconstitute the RF waveform over the CATV cable. In some embodiments, the payloads of IP packets are QAM symbols, and the EN sends RF waveforms that are QAM modulated according to the received QAM symbols.

The cable system 100 also includes a controller 190. In some embodiments, the controller 190 handles the control and configuration of the cable system 100, particularly the devices and equipment at the cable head end. In some embodiments the controller 190 also controls the operation and configuration of remote distribution nodes 131-135. In some embodiments, the controller 190 is located at the head end 110 so it can control the equipment at the head end (e.g., a packet engine) directly. In some of these embodiments, the controller 190 remotely controls the remote distribution nodes through the data distribution network 120. In some embodiments, the controller is connected to the packet switch (e.g., 160) that connects to both the cable head end 110 and the remote distribution nodes 131-135.

The cable system 100 is for delivering a variety of data services through cable modems to each service nodes. These data services include cable set top box (STB), customer premise equipment (CPE), Voice over IP, multimedia terminal adapter (MTA), etc. In some embodiments, each of these data services is referred to as a cable service flow, as each of these data services requires a flow of data between the cable head end and a cable modem. It is also a unit that requests and consumes specific data (e.g., on-demand services), hence can also be referred to as a cable service-consuming unit.

For some embodiments, FIG. 2 illustrates cable service flows in the cable system 100. As illustrated, the cable system 100 includes the cable head end 110 that is connected to remote distribution nodes 131-133 (EN1-EN3) through the distribution network 120 (not illustrated). The remote distribution nodes are in turn each connected to a set of service nodes through neighborhood CATV cables. Specifically, the remote distribution node 131 (EN1) is connected to service nodes 151-152 through CATV cables 141, the remote distribution node 132 (EN2) is connected to service nodes 153-154 through CATV cables 142, and the remote distribution node 133 (EN3) is connected to service nodes 155-157 through CATV cables 143.

Each service node in turn subscribes to a set of cable service flows. In the example illustrated in FIG. 2, the service node 151 subscribes to services STB1, MTA1, and CPE1, while the service node 152 subscribes services Host2, CPE2, and STB1. As mentioned above, in some embodiments, a service node is equipped with one or more cable modems for modulating and demodulating the data for the subscribed cable service flows. In some embodiments, some service flows can simultaneously serve multiple service nodes or are provided through different cable modems. For example, the service flow STB1 simultaneously serves both the service node 151 and the service node 152.

In some embodiments, the source of the data of each of the service flows is the cable head end, which has access to resources for providing the services. As illustrated, the cable head end 110 has access to the network resources 170, which includes Internet access and network packet forwarding (L2 switch and/or L3 routing). The cable head end 110 also has access to the media content storage 112 for directly providing services such as cable TV programming without going through the Internet.

I. Addressable Service Flows in IP Network

In some embodiments, each cable service flow is regarded as a network node by the cable system 100 so it can inject data into the network as a source, and/or receive data from the network as a destination. In some embodiments, the cable head end 110 includes a packet engine for handling the exchange of network data to and from each of the cable service flows. In some embodiments, the packet engine has an array of logical interfaces, and each cable service flow is assigned one of these logical interfaces. Each logical interface is configured to receive data or data packets from its corresponding cable service flow and to provide data or data packet to its corresponding cable service flow. The packet engine in turn performs data packet exchange between the logical interfaces and the network, which includes L2 switches, L3 routers, network services (such as DHCP, firewall, NAT, etc.), access to Internet or other external networks (through a gateway/an edge router), etc. There are many devices available in the market that can serve as the packet engine for some embodiments of the invention, including MX™ series router by Juniper™ or 12000™ series router by Cisco™.

FIG. 3 illustrates a packet engine 115 that is configured to handle packet exchange for cable service flows in the cable system 100. It is controlled and configured by the controller 190, which also controls and configures the remote distribution nodes 131-134. As illustrated, the cable head end 110 of the cable system 100 includes the packet engine 115. The cable head end 110 is in communication (e.g., through optical fiber) with the remote distribution nodes (i.e., ENs or FNs) 131-134. Each remote distribution node provides several service flows to service node users through neighborhood CATV cables and cable modems (not illustrated). Specifically, the remote distribution node 131 is providing service flows 201-204 (CSF1-CSF4), the remote distribution node 132 is providing service flows 205-208 (CSF5-CSF8), the remote distribution node 133 is providing service flows 209-212 (CSF9-CSF12), and the remote distribution node 134 is providing service flows 213-216 (CSF13-CSF16).

The packet engine 115 includes an array of logical interfaces 301-316. Each of the logical interfaces is assigned to a cable service flow in the cable system 100. Specifically, the logical interface 301-316 are assigned to cable service flows CSF1-16, respectively.

In some embodiments, identifiers of cable service flows in a cable system may not be unique, because two different cable service flows served by two different remote distribution nodes may have the same identifier. Some embodiments therefore ensure the unique identification of each cable service flow by using the identifier of its remote distribution node in addition to its own identifier. Consequently, each logical interface in the packet engine 115 is uniquely identifiable by (or associated with) a compound identifier that includes the identifier of the corresponding service flow and the identifier of the remote distribution node. For example, the logical interface 302 of the service flow 202 (CSF2) is identifiable by the compound identifier [EN1:CSF2], and the logical interface 307 of the service flow 207 (CSF7) is identifiable by the compound identifier [EN2:CSF7]. By including the identifier of the remote distribution node, the system is able to uniquely identify service flows 202 and 207, even if CSF2 and CSF7 have identifiers that are identical to each other.

The packet engine is configured to assign a logical interface to each of these cable service flows, and each of these logical interfaces is associated with a compound identifier for its corresponding service flow. Different embodiments define service flows differently. In some embodiments, each service flow is defined as a service unit under a cable bundle. In some embodiments, each service flow is defined as a cable modem, or as the subscribing household. Consequently, the identifiers associated with a cable service flow that are used to create a compound identifier are different in different embodiments. FIGS. 4 and 5 illustrates two different definitions of cable service flows.

FIG. 4 illustrates cable service flows that are each a service unit under a cable bundle. Cable bundles are a bundle of services as defined by DOCSIS. As illustrated, the remote distribution node 131 (EN1) serves two different cable bundles in its neighborhood, cable bundle 1 (CB1) and cable bundle 2 (CB2). The cable bundle CB1 has a service unit that corresponds to CPE services and a service unit that corresponds to STB services. Each of these two service units is defined as a service flow (CPE service of CB1 is service flow CSF1 201, STB service of CB1 is service flow CSF2 202). The cable bundle CB2 has a service unit that correspond to STB services and a service unit that correspond to MTA services. Each of these two service units of CB2 is also defined as a service flow (STB service of CB2 is service flow CSF3 203, STB service of CB2 is service flow CSF4 204).

Packets from the service flows CSF1-CSF4 goes through the remote distribution node 131 (EN1) to reach their respective logical interfaces 401-404 in the packet engine. In some embodiments, the identifier of the cable bundle and the identifier of the service unit form a compound identifier [cable bundle identifier, service identifier] for the service unit. The compound identifier of the service unit is then further compounded with the identifier of the remote distribution node to form a compound identifier for uniquely identifying the service flow. For example, the logical interface 401 is assigned to the service flow CSF1 (CPE service of cable bundle 1) and is associated with compound identifier [EN1: CB1,CPE], while the logical interface 403 is assigned to the service flow CSF3 (STB service of cable bundle 2) and is associated with compound identifier [EN1:CB2, STB].

FIG. 5 illustrates cable service flows that are each defined as a cable modem. As illustrated, the remote distribution node 131 (EN1) serves at least two cable modems in the neighborhood, 551 (CM1) and 552 (CM2). Though cable modems 551 and 552 each provides several services to its respective households or service nodes (CM1 provides STB, MTA and CPE services; CM2 provides host, CPE, and STB services), all of the services provided by one cable modem is considered a cable service flow, and that cable service flow is assigned a corresponding logical interface in the packet engine. As illustrated, all of the services provided through the cable modem CM1 are defined to be the service flow 201 (CSF1), and the all of the services provided through the cable modem CM2 are defined to be the service flow 201 (CSF2).

Packets from these service flows goes through the remote distribution node 131 (EN1) to reach their respective logical interfaces 501-502 in the packet engine. A compound identifier for a CM based service flow includes the identifiers of the remote distribution node and the cable modem. For example, the logical interface 501 is assigned to the service flow CSF1 (services of CM1) and is associated with compound identifier [EN1:CM1], while the logical interface 502 is assigned to the service flow CSF2 (services of CM2) and is associated with compound identifier [EN1:CM2].

In some embodiments, each cable service flow is defined to be a service node of a subscriber. In such instances, a cable service flow includes all of the services delivered to a subscriber through the subscriber's cable modem(s) and service specific devices in a house, apartment, office, etc.

II. Assign Class of Service to Service Flows

In some embodiments, each service flow is assigned a class of service (CoS) at the packet engine and guarantee a certain level of quality of service (QoS). In some embodiments, each cable service flow is assigned a CoS priority number. For each possible CoS priority number, the packet engine is configured to provide certain resources at certain quality level, i.e., certain level of QoS. In some embodiments, each remote distribution node (FN or EN) tags each packet of a cable service flow with its assigned CoS priority number and forwards the tagged packet toward the packet engine.

FIG. 6 illustrates the assignment CoS priority numbers and the configuration of the packet engine 115 for the service flows of the cable system 100. The figure illustrates three sets of configuration data 610, 620, and 630. In some embodiments, the controller 190 of the cable system 100 generates these sets of configuration data. As illustrated, the configuration data set 610 is for configuring the remote distribution node 131-133, the configuration data set 620 is for configuring the logical interfaces of the packet engine 115, and the configuration data set 630 is for configuring a class of service controller 690 of the packet engine 115.

The configuration data set 610 specifies the CoS priority number of each of the cable service flows. For example, according to the configuration data set 610, the cable service flow 201 (CSF1) of the remote distribution node 131 (EN1) is assigned CoS priority number 4, the cable service flow 202 (CSF2) of the remote distribution node 131 (EN1) is assigned CoS priority number 5, the cable service flow 212 (CSF12) of the remote distribution node 133 (EN3) is assigned CoS priority number 12, etc.

The configuration data set 620 specifies the association between the cable service flows and the logical interfaces in the packet engine such that each cable service flow has one logical interface in the packet engine 115 that is configured to handle its traffic. For example, the configuration data set 620 assigns the logical interface 301 to the cable service flow 201 (CSF1) of the remote distribution node 131 (EN1), the logical interface 312 to the cable service flow 212 (CSF12) of the remote distribution node 133 (EN3), etc.

The configuration data set 630 specifies the QoS configurations of each of the possible CoS priority numbers (e.g, priority 1 QoS configuration, priority 2 QoS configuration, etc.). The QoS configuration of a particular CoS priority in some embodiments specify a class of service that is based on a certain allotment of queues, access to computing and network resources, etc.

FIG. 7 illustrates tagging packets of a service flow with the service flow's assigned CoS priority number. The packet engine is already configured with the QoS configurations of the various possible CoS priority numbers. (e.g. QoS configurations for priorities 3, 5, etc).

The tagging is performed by the remote distribution node according to its CoS priority number configuration (e.g., configuration set 610) that specifies the CoS priorities for all of the service flows. Once the packet reaches the packet engine, the CoS priority number in the tag is used by the packet engine to identify the corresponding QoS configuration. The packet engine then uses the identified QoS configuration to select resources of the packet engine to perform the necessary processing.

As illustrated, the service flow 203 (CSF3) produces a packet 711 to be transmitted to the packet engine 115 through the remote distribution node 131 (EN1). The remote distribution node 131 in turn tags the packet with the CoS priority number of service flow 203, which is configured to be 5. Once the packet 711 reaches the logical interface 303 (which is configured to handle the service flow 203/CSF3), the tagged priority number “5” of the packet 711 is used by the packet engine to identify a QoS configuration for the CoS priority number “5”. The packet engine 115 then uses this QoS configuration to select resources to process the packet. Likewise, a packet 712 from the service flow 212 (CSF12) is tagged with its CoS priority number “3” by its remote distribution node 133 (EN3); the tagged priority number “3” is in turn used by the packet engine to identify a QoS configuration for the priority number “3”. The packet engine 115 then uses this identified QoS configuration to select resources to process the packet.

For some embodiments, FIG. 8 conceptually illustrates a process 801 for configuring the packet engine and the remote distribution nodes in order to implement QoS specification for the service flows. In some embodiments, the process is performed by a controller of a cable system such as the controller 190 in a cable head end.

The process starts when it receives (at 810) specification for cable service flows that are to be handled by the packet engine. In some embodiments, this entails learning the identities of the cable service flows (the corresponding cable bundle and service, or the cable modem) as well as the identities of the remote distribution node (FN or EN) that is responsible for converting between DOCSIS RF signals over CATV cables and IP packets over optical fibers.

Next, the process configures (at 820) the packet engine to provide a logical interface for each of the specified service flows. In some embodiments, each service flow is associated with identifiers (or a compound identifier) that identify the remote distribution node and the cable service flow. In some embodiments, each logical interface is further configured to recognize packets with its associated identifiers as the packets from its corresponding service flow. An example of such a configuration is described by reference to the configuration data set 620 in FIG. 6.

The process then assigns (at 830) a CoS priority (number) to each of the service flows. A service flow with certain CoS priority number will be entitled to certain resources based on certain level of QoS in the packet engine. The process also forwards the assigned CoS priorities (priority numbers) to the remote distribution nodes so the remote distribution nodes can tag packets of a service flow with the service flow's corresponding priority. An example of such assignment is described above by reference to the configuration data set 610 in FIG. 6.

The process also generates (at 840) a QoS configuration for each of the CoS priority numbers. In some embodiments, a QoS configuration for a particular CoS priority number specifies a particular class of resources (certain performance level, cost, queue, etc.) that will be available to process packets associated with that CoS priority number. The QoS configurations are then programmed into the packet engine. Such configuration is described above by reference to configuration data set 630 in FIG. 6. The use of QoS configuration to determine resource allocation by the packet engine is described above by reference to FIG. 7. The process 801 then ends.

FIG. 8 also conceptually illustrates a process 802 for tagging packets of a service flow according to its assigned QoS priority. In some embodiments, a remote distribution node (EN or FN) performs the process 802 when it converts data received from RF channels into IP packets destined for the packet engine in the cable head end.

The process starts when it receives (at 850) data from cable modems through RF channels (e.g., DOCSIS channels) over the CATV cable from cable modems. The process then identifies (at 860) the cable service flow that the received data belongs to.

Next, the process identifies (at 870) the QoS priority (number) that was assigned to the identified cable service flow. In some embodiments, this QoS priority assignment is provided by the controller of the cable system through a process similar to the process 801.

The process then (at 880) tags the data with the identified QoS priority to create a tagged packet for the packet engine. In some embodiments, the remote distributed node formats the data received from the cable service flow into IP packet, in some embodiments, the data from the cable service flows is already in IP packet format. In ether instance, the process adds the QoS priority tag to the packet. The process then transmits (at 890) the priority tagged packet to the packet engine (through the distribution network/fiber network) and ends.

Though not illustrated, in some embodiments, the controller would send out updates for the CoS priority assignments and/or QoS configurations to the packet engine and the remote distribution nodes. The remote distribution nodes would receive updated CoS priority assignments for some or all of the service flows during the operation of the remote distribution nodes. The remote distribution node would then use the updated priority numbers to tag the subsequent packets with the updated priority numbers. Such update in some embodiments dynamically changes the priority assignments on the fly by promoting or demoting the QoS for some or all of the service flows.

III. Electronic System

Many of the above-described features and applications are implemented as software processes that are specified as a set of instructions recorded on a computer readable storage medium (also referred to as computer readable medium). When these instructions are executed by one or more processing unit(s) (e.g., one or more processors, cores of processors, or other processing units), they cause the processing unit(s) to perform the actions indicated in the instructions. Examples of computer readable media include, but are not limited to, CD-ROMs, flash drives, RAM chips, hard drives, EPROMs, etc. The computer readable media does not include carrier waves and electronic signals passing wirelessly or over wired connections.

In this specification, the term “software” is meant to include firmware residing in read-only memory or applications stored in magnetic storage, which can be read into memory for processing by a processor. Also, in some embodiments, multiple software inventions can be implemented as sub-parts of a larger program while remaining distinct software inventions. In some embodiments, multiple software inventions can also be implemented as separate programs. Finally, any combination of separate programs that together implement a software invention described here is within the scope of the invention. In some embodiments, the software programs, when installed to operate on one or more electronic systems, define one or more specific machine implementations that execute and perform the operations of the software programs.

FIG. 9 conceptually illustrates an electronic system 900 with which some embodiments of the invention are implemented. The electronic system 900 can be used to execute any of the control, virtualization, or operating system applications described above. The electronic system 900 may be a computer (e.g., a desktop computer, personal computer, tablet computer, server computer, mainframe, a blade computer etc.), phone, PDA, or any other sort of electronic device. Such an electronic system includes various types of computer readable media and interfaces for various other types of computer readable media. Electronic system 900 includes a bus 905, processing unit(s) 910, a system memory 925, a read-only memory 930, a permanent storage device 935, input devices 940, and output devices 945.

The bus 905 collectively represents all system, peripheral, and chipset buses that communicatively connect the numerous internal devices of the electronic system 900. For instance, the bus 905 communicatively connects the processing unit(s) 910 with the read-only memory 930, the system memory 925, and the permanent storage device 935.

From these various memory units, the processing unit(s) 910 retrieves instructions to execute and data to process in order to execute the processes of the invention. The processing unit(s) may be a single processor or a multi-core processor in different embodiments.

The read-only-memory (ROM) 930 stores static data and instructions that are needed by the processing unit(s) 910 and other modules of the electronic system. The permanent storage device 935, on the other hand, is a read-and-write memory device. This device is a non-volatile memory unit that stores instructions and data even when the electronic system 900 is off. Some embodiments of the invention use a mass-storage device (such as a magnetic or optical disk and its corresponding disk drive) as the permanent storage device 935.

Other embodiments use a removable storage device (such as a floppy disk, flash drive, etc.) as the permanent storage device. Like the permanent storage device 935, the system memory 925 is a read-and-write memory device. However, unlike storage device 935, the system memory is a volatile read-and-write memory, such a random access memory. The system memory stores some of the instructions and data that the processor needs at runtime. In some embodiments, the invention's processes are stored in the system memory 925, the permanent storage device 935, and/or the read-only memory 930. From these various memory units, the processing unit(s) 910 retrieves instructions to execute and data to process in order to execute the processes of some embodiments.

The bus 905 also connects to the input and output devices 940 and 945. The input devices enable the user to communicate information and select commands to the electronic system. The input devices 940 include alphanumeric keyboards and pointing devices (also called “cursor control devices”). The output devices 945 display images generated by the electronic system. The output devices include printers and display devices, such as cathode ray tubes (CRT) or liquid crystal displays (LCD). Some embodiments include devices such as a touchscreen that function as both input and output devices.

Finally, as shown in FIG. 9, bus 905 also couples electronic system 900 to a network 965 through a network adapter (not shown). In this manner, the computer can be a part of a network of computers (such as a local area network (“LAN”), a wide area network (“WAN”), or an Intranet, or a network of networks, such as the Internet. Any or all components of electronic system 900 may be used in conjunction with the invention.

Some embodiments include electronic components, such as microprocessors, storage and memory that store computer program instructions in a machine-readable or computer-readable medium (alternatively referred to as computer-readable storage media, machine-readable media, or machine-readable storage media). Some examples of such computer-readable media include RAM, ROM, read-only compact discs (CD-ROM), recordable compact discs (CD-R), rewritable compact discs (CD-RW), read-only digital versatile discs (e.g., DVD-ROM, dual-layer DVD-ROM), a variety of recordable/rewritable DVDs (e.g., DVD-RAM, DVD-RW, DVD+RW, etc.), flash memory (e.g., SD cards, mini-SD cards, micro-SD cards, etc.), magnetic and/or solid state hard drives, read-only and recordable Blu-Ray® discs, ultra density optical discs, any other optical or magnetic media, and floppy disks. The computer-readable media may store a computer program that is executable by at least one processing unit and includes sets of instructions for performing various operations. Examples of computer programs or computer code include machine code, such as is produced by a compiler, and files including higher-level code that are executed by a computer, an electronic component, or a microprocessor using an interpreter.

While the above discussion primarily refers to microprocessor or multi-core processors that execute software, some embodiments are performed by one or more integrated circuits, such as application specific integrated circuits (ASICs) or field programmable gate arrays (FPGAs). In some embodiments, such integrated circuits execute instructions that are stored on the circuit itself.

As used in this specification, the terms “computer”, “server”, “processor”, and “memory” all refer to electronic or other technological devices. These terms exclude people or groups of people. For the purposes of the specification, the terms display or displaying means displaying on an electronic device. As used in this specification, the terms “computer readable medium,” “computer readable media,” and “machine readable medium” are entirely restricted to tangible, physical objects that store information in a form that is readable by a computer. These terms exclude any wireless signals, wired download signals, and any other ephemeral signals.

While the invention has been described with reference to numerous specific details, one of ordinary skill in the art will recognize that the invention can be embodied in other specific forms without departing from the spirit of the invention. In addition, a number of the figures (including FIG. 8) conceptually illustrate processes. The specific operations of these processes may not be performed in the exact order shown and described. The specific operations may not be performed in one continuous series of operations, and different specific operations may be performed in different embodiments. Furthermore, the process could be implemented using several sub-processes, or as part of a larger macro process. Thus, one of ordinary skill in the art would understand that the invention is not to be limited by the foregoing illustrative details, but rather is to be defined by the appended claims. 

What is claimed is:
 1. A method for configuring a cable system that comprises a cable head end and a plurality of remote distribution nodes for relaying signals between the cable head end and a plurality of cable modems, the method comprising: for each of a plurality of cable service flows in the cable system, assigning a unique identifier and a priority number for specifying a quality of service to be provided by a packet engine in the cable head end; and providing the unique identifiers and the assigned priority numbers to the plurality of remote distribution nodes, wherein each remote distribution node tags data in a particular cable service flow of the plurality of cable service flows transmitted by one of the plurality of cable modems to the packet engine with the assigned unique identifier of the particular cable service flow and the priority number of the particular cable service flow, wherein the unique identifier of the particular cable service flow includes a first tag identifying the particular cable service flow and a second tag identifying a remote distribution node processing the particular cable service flow; and wherein the packet engine comprises a plurality of logical interfaces, each logical interface configured to handle a different cable service flow, wherein the first and second tags are jointly used to identify one of the plurality of logical interfaces in the packet engine that is configured to handle the particular cable service flow.
 2. The method of claim 1 further providing a plurality of quality of service (QoS) configurations to the packet engine, each QoS configuration corresponding to a priority number.
 3. The method of claim 1, wherein each remote distribution node is a fiber node (FN) that transmits and receives digital data over an optical fiber network with the cable head end.
 4. The method of claim 1, wherein each remote distribution node is an ether node (EN) that is in Internet Protocol (IP) communication with the cable head end.
 5. The method of claim 1, wherein radio frequency (RF) signals are received over RF channels that are established over cable television (CATV) cables with the plurality of cable modems.
 6. The method of claim 1, wherein the packet engine is for providing access to the Internet and for providing L2/L3 routing to each of the plurality of cable service flows.
 7. A method of providing services in a cable system that comprises a cable head end and a plurality of remote distribution nodes for relaying signals between the cable head end and a plurality of cable modems, the method comprising: receiving, at a remote distribution node, a set of priority assignments for each of a plurality of cable service flows in a cable system, each priority assignment for specifying a quality of service to be provided by a packet engine in the cable head end; receiving data for a particular cable service flow at the remote distribution node from the set of cable modems; generating a packet based on the received data for the particular cable service flow and forwarding the generated packet to the packet engine, wherein generating said packet comprises inserting a priority number into the packets based on the priority assignment of the particular cable service flow and a unique identifier of the particular cable service flow, wherein the unique identifier of the particular cable service flow includes a first tag identifying the particular cable service flow and a second tag identifying a remote distribution node processing the particular cable service flow; and wherein the packet engine comprises a plurality of logical interfaces, each logical interface configured to handle a different cable service flow, wherein the first and second tags are jointly used to identify one of the plurality of logical interfaces in the packet engine that is configured to handle the particular cable service flow.
 8. The method of claim 7, wherein each priority number corresponds to a set of resource configurations in the packet engine that correspond to a class of service.
 9. The method of claim 7, wherein each remote distribution node is a fiber node (FN) that transmits and receives digital data over an optical fiber network with the cable head end.
 10. The method of claim 7, wherein each remote distribution node is an ether node (EN) that is in Internet Protocol (IP) communication with the cable head end.
 11. The method of claim 7, wherein RF signals are received over RF channels that are established over CATV cables with the plurality of cable modems.
 12. The method of claim 7, wherein the packet engine is for providing access to the Internet and for providing L2/L3 routing to each of the plurality of cable service flows.
 13. The method of claim 7, wherein the packet engine comprises a plurality of logical interfaces, each logical interface configured to handle a different cable service flow.
 14. A system comprising: a cable head end comprising a packet engine; a set of cable modems for providing a plurality of cable service flows; a set of remote distribution nodes for receiving RF signals from the plurality of cable modems and for forwarding packets to the cable head ends, the packets created based on the received RF signals for the plurality of cable service flows; and a controller for assigning a priority number for specifying a quality of service to be provided by a packet engine in the cable head end and providing the assigned priority number to the plurality of remote distribution nodes, wherein each remote distribution node tags data from a cable service flow to the packet engine with the assigned priority number of the cable service flow and a unique identifier of the cable service flow; and wherein the packet engine comprises a plurality of logical interfaces, each logical interface configured to handle a different one of the plurality of cable service flows, wherein the first and second tags are jointly used to identify one of the plurality of logical interfaces in the packet engine that is configured to handle the cable service flow.
 15. The system of claim 14, wherein the controller is further for providing a plurality of quality of service (QoS) configurations to the packet engine, each QoS configuration corresponding to a priority number.
 16. The system of claim 14, wherein each remote distribution node is a fiber node (FN) that transmits and receives digital data over an optical fiber network with the cable head end.
 17. The system of claim 14, wherein each remote distribution node is an ether node (EN) that is in Internet Protocol (IP) communication with the cable head end.
 18. The system of claim 14, wherein the RF signals are received over RF channels that are established over CATV cables with the plurality of cable modems.
 19. The system of claim 14, wherein the packet engine is for providing access to the Internet and for providing L2/L3 routing to each of the cable service flows. 